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ABSTRACT 


This study tested the effectiveness of the cloze procedure, 
used aurally, to teach listening comprehension in English as a foreign 
language (EFL) . Subjects were the classes of two teachers (n=74, n=75) ; one 
teacher taught using the aural cloze procedure, and the other taught using 
conventional listening instruction techniques. In aural cloze instruction, 
the teacher would read the cloze text aloud; at the end of sentence, students 
worked cooperatively in small groups to supply the deleted words and 
participate in teacher-led discussions about the various possible answers. In 
conventional instruction, students were read the entire text aloud, then 
answered questions orally or in writing, matched sentences with pictures, or 
drew or completed a map or picture. Comparison of pre- and posttest results 
for both groups reveals that the aural cloze treatment group performed better 
than the conventional treatment group after instruction. The pretest/posttest 
is appended. Contains 36 references. (MSE) 
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Introduction 


• Points of view or opinions stated in this 
document do not necessarily represent 
official OERI position or policy. 


<n Over the last two decades attention has been directed towards the feasibility of using the cloze procedure 


as a teaching technique for developing comprehension skills. A plethora of articles have appeared 


Q extolling the instructional virtues of this technique. In an article entitled “Using the cloze procedure as a 
teaching technique,” Radice (1978: 201-203) summarizes the advantages of this procedure as follows: 1) 


ease of preparation, 2) ease of administration, 3) immediate knowledge of results, 4) feedback to the 
teacher, 5) suitability for group correction, 6) flexibility, and 7) separation of grammatical difficulties. 
Theoretical support for the cloze procedure as a teaching technique also comes from Richardson (cited in 
Bastidas 1989: 91) who states that: 

The cloze procedure provides both the teacher.and the pupil with a new and stimulating 
way to acquire and apply skills. The myriad uses of the cloze procedure coupled with the 
simplicity of construction makes it a very useful tool for each classroom. 

Gefen (1979: 123) gives farther support for the cloze procedure as a teaching technique. He writes: 

... a cloze passage is far more than a complex completion exercise: it is an aspect of 
controlled composition (oral or written) and demands of the learner a more creative 
approach to language learning and language use as well as an involvement with the 
passage as a whole. . . . 


Supporting Gefen’s view, Lev and Miluse Soudek (1983: 336-337) state that: 

Whether used in language testing or as a versatile exercise in a variety of teaching 
situations, the cloze procedure aims at a multitude of abilities (see, e. g. Brown 1980: 
214) that constitute the learner’s communicative competence in asecondlanguage.lt 
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addresses the lexical, semantic, and syntactic inter-relationships which characterize the 
unique structure of a language. In this respect it reflects both the Gestalt concept of 
wholeness and the view of language as a system comprising integrated subsystems, as 
espoused particularly by Prague school of structuralists. 

A final advantage, noted by Seifeddin (1988: 235), is that the cloze procedure as a teaching technique 
helps teachers to diagnose and overcome the difficulties learners encounter. 

Despite the many advantages of the cloze procedure as a teaching technique, some ELT specialists have a 
bias against using this technique in language teaching in general. One reason for the bias against this 
technique is that it is difficult to process even if it is easy to create (Gillingham and Gamer 1992: 235). 
Another reason is that it does not rely directly on higher levels of text comprehension such as 
intersentence and paragraph comprehension (loc. cit.). 


In summary, the controversy among language teaching theorists, regarding the effectiveness of the cloze 
procedure as a teaching technique, makes research urgently needed in this area to prove or disprove 
existing theories. 


Review of empirical literature 

Previous literature has mainly focused on using the cloze procedure for teaching reading comprehension 
(e. g., Binkly 1975, Cox 1974, Culhane 1973, Faubion 1972, Guscott 1972, Paradis and Bayne 1977, 
Pepin 1974, Rhodes 1973, Whitmer 1975, Yellin 1978). However, only two studies involved the use of 
the cloze procedure as a teaching technique in the area of listening (Hasson 1981, Kennedy and Weener 
1973). Hasson (1981) investigated the effectiveness of aural cloze as an instructional technique in 
improving kindergarten children’s vocabulary and listening comprehension. The aural cloze instruction 
used in her study involved reading stories aloud to children and having them supply words deleted from 
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the story. The study was designed with a control group which did not receive instruction in aural cloze. 
The results revealed no significant differences in vocabulary or listening comprehension between students 
who received aural cloze instruction and those who did not. Kennedy and Weener (1973) investigated the 
effects of visual and auditory cloze training on listening and reading comprehension. One experimental 
group received training in visual cloze and the other experimental group received training in auditory 
cloze. The findings indicated that both the experimental groups performed significantly higher (p<0.05) 
than the two control groups on both written and aural cloze posttests. 

From the review of the empirical literature, it is clear that: 1) very little research has been conducted 
relating cloze and listening comprehension, 2) there is conflicting evidence on the usefulness of cloze as a 
teaching technique for enhancing listening comprehension, and 3) no studies have been found that 
involved the use of aural cloze as a teaching technique with ESL/EFL students. 


Purpose of the study 

The purpose of this study was to determine the effect of aural cloze instruction on the listening 
comprehension of EFL students. 

Research variables '' 

The independent variables in this study were: 1) aural cloze instruction, 2) regular listening instruction. 
In aural cloze instruction, the teacher read the cloze text aloud. During reading he said the word ‘blank’ at 
each deletion. At the end of each sentence, students worked cooperatively in small groups to supply the 
deleted word and then participated in teacher-led discussions. These discussions focused upon the various 
answers that could be used in a cloze blank and upon the reasons for a particular answer being correct or 
incorrect within the sentence. In regular listening instruction, students were read the text. They were then 
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asked to show their comprehension in one of the following ways: 1) answering questions orally or in 
writing, 2) matching sentences with pictures, 3) drawing or completing a map or picture. 

The dependent variable was EFL students’ listening comprehension. 

Research hypotheses 

The hypotheses of concern in this study were stated as follows: 

1 . There would be no statistically significant difference in the mean scores on the pretest between the 
experimental group and the control group. 

2. There would be no statistically significant difference in the mean scores on the posttest between the 
group which received aural cloze instruction and the group that remained in the regular classroom. 

Teaching materials 

The seventeen listening texts, which appear in the teacher’s manual Welcome to English, Teacher’s Book 
3 together with the listening exercises in Welcome to English Workbook 3, were used with the control 
group. The same texts were modified into instructional cloze materials and used with the experimental 
group. The lexical or rational cloze deletion method was used in developing the aural cloze materials. In 
this method, the deletions (one per sentence) were made only for meaning-bearing words such as nouns, 
verbs, and adjectives as used by Hasson (1973), Kennedy and Weener (1973). This deletion method, as 
Jongsma (1980: 17) sees it, appears to be “more effective instructionally than semi-random deletion 
systems such as every-nth word or every-nth noun-verb.” 


Instrument 

To verify the hypotheses of the study, a listening comprehension test was constructed to be used as a pre- 
and post-test. This test comprised four sections (five items in each). All test items were entirely 
independent of the speaking, reading and writing skills so that the testees could score up to their own 
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listening abilities (see Appendix A). Prior to using the test in the study, its content validity was 

established by the process of expert judgment. Seven inspectors and 3 university teachers reviewed the 
test items for relevance. Furthermore, the test reliability was assessed by administering the test to a pilot 
group (n= 37) and calculating the coefficient alpha for each set of items. The coefficient alpha for the 
first section was 0.81 , for the second section was 0.88, for the third section was 0.78, and for the fourth 
section was 0.86. These coefficient alphas indicated that the overall instrument was internally consistent. 

Procedure 

Before the start of the study, the two participating teachers were randomly assigned to the treatment 
conditions by Hipping a coin. After that each teacher went through a training session, lasting for three 
hours, in the use of the method to which he was assigned. At the beginning of the study, all subjects were 
pretested. The pretest data were then analyzed by using the t-test. Following pretesting, each teacher 
taught the seventeen listening texts to his classes over a period of six months from October 1994 until 
March 1995. The two teachers taught from detailed lesson plans that were developed by the researcher to 
ensure that the same listening texts would be taught through using the two methods of the study. 
Additionally, both teachers followed the textbook writer’s procedures in teaching the other skills 
(speaking, reading and writing). Throughout the duration of the study, the researcher continued to visit 
the participating teachers for in-class follow-up and coaching. At the end of the study, all subjects were 
posttested. Then the subjects’ responses to the posttest were scored without knowledge of group 
affiliation. Finally, the posttest scores were analyzed using the t-test for independent measures. 
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Findings and discussion 
Pretest results 

Table 1 

The difference in the mean scores between the experimental group and 
the control group on the pretest 


Group 

N 

M 

S.D. 

t-value 

Experimental 

74 

3.47 

1.34 

1.03 

Control 

75 

3.27 

1.10 


As shown in Table 1, the t-test for the pretest data revealed no significant differences in the mean scores 
between the experimental group and the control group (t=1.03, p= n. s.). Therefore, the first null 
hypothesis was accepted. This result may be attributed to the fact that all subjects studied the same 
textbooks for the same amount of time. This suggests that the two groups of the study were fairly 
equivalent in their listening comprehension at the beginning of the study. 


Posttest results 



Table 2 

The difference in the mean scores between the experimental group and 


the control group on the posttest 


Group 

N 

M 

S. D. 

t-value 

Experimental 

74 

12.28 

2.58 

7.01 

Control 

75 

9.36 

2.51 
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As shown in Table 2, the average mean score for the group exposed to aural cloze instruction was 
12.28 (S. D.= 2.58) and for the group exposed to regular instruction was 9.36 (S. D.= 2.51). The 

difference between the two means was 2.92. The obtained t- value for this difference was 7.01 which was 
statistically significant at the 0.05 level of confidence. Therefore, the second null hypothesis was rejected. 
There are five possible explanations for this finding: 1) aural cloze instruction might provide students 
with confidence in guessing the meaning of unknown words from the context before panicking or giving 
up in despair, 2) the discussion accompanying the cloze practices might help the students learn new 
concepts and new labels for these concepts, 3) aural cloze instruction might increase the facility of 
understanding how various words in a sentence fit together to make sense, 4) aural cloze instruction might 
require more participation on the part of the learner than regular instruction, and 5) students might enjoy 
aural cloze instruction more than regular instruction. 


Directions for future research 

The following directions for future research are suggested by the study: 

1 . Exploring the effect of random versus selective deletions on EFL listening comprehension. 

2. Exploring the effect of cloze instruction with and without discussion on EFL listening comprehension. 

3. Exploring the effect of lexical versus syntactic deletions on EFL listening comprehension. 

4. Exploring the effect of aural cloze instruction for different listening levels. 

5. Exploring the effect of word versus sentence deletions on EFL listening comprehension. 


References 

Alexander, L. (1977). Question and Answer, Graded Oral Comprehension Exercises. U. K.: Longman 
Group Ltd. 

Anderson, J. (1972). The application of cloze procedure to English as a foreign language in Papua and 
New Guinea. English Language Teaching 27: 1. pp. 66-72. 


0 

ERIC 


8 


i 


o 


Bastidas, Jesus A. (1989). The cloze procedure as a teaching technique to improve reading 
comprehension. A Forum Anthology 4. pp. 90- 94. 

Binkley, J. P.(1975). Cloze procedure in German for teaching and testing reading at the intermediate 
level. Dissertation Abstracts International 36. pp. 677A-678A. 

Blachowicz, C. L. (1977). Cloze activities for primary readers. The Reading Teacher 31. pp. 300-302. 

Blackwell, J. M. , Thompson, R., and Dziuban, C. (1972). An investigation into the effectiveness of the 

cloze procedure as a vocabulary tool. Journal of Reading Behavior 4. pp. 53-54. 

Bortnick, R. , and Lopardo, G. (1973). An instructional application of the cloze procedure. Journal of 
Reading 16. pp. 296-300. 

Cox. J. K. A comparison of two instructional methods utilizing the cloze procedure and a more traditional 
method for improving reading comprehension and vocabulary in context in a disadvantaged fourth- 
grade elementary school sample. Dissertation Abstracts International 35. 6569A. 

Culhane, J. W. (1970). Cloze procedure and comprehension. The Reading Teacher 23. pp. 410-413. 

(1973). The use of an iterative research process to study the adaptation of cloze for 

improving the reading comprehension of expository materials. Dissertation Abstracts 
International. 24. 991 A.. 

Faubion, N. N. (1972). The effect of training in the use of cloze on the ability of fourth grade pupils to 
gain information from written discourse. Dissertation Abstracts International. 32 . 4486A. 

Gefen, R. (1979). An experiment with cloze testing. ELT Journal 33: 2. pp. 122-126. 

Gillingham, M. and Garner, R. (1992). Reader’s comprehension of mazes embedded in expository texts. 
Journal of Educational Research. 85: 4. pp. 234-241 

Guscott, C. E. (1972). The effect of cloze procedure exercises on the improvement of reading 
achievement and reading comprehension of selected sixth-grade students. Dissertation Abstracts 
International 32. 3861 A. 



9 


Hasson, Elizabeth A. (1981). The use of aural cloze as an instructional technique for the enhancement of 
vocabulary and listening comprehension of kindergarten children. Unpublished doctoral 


dissertation, Temple University. 

Houston, A. (1976). An analysis of the cloze procedure as a teaching technique with disadvantaged 
children. Dissertation Abstracts International 36. 6459A. 

Jongsma. E. (1971). The Cloze Procedure as a Teaching Technique. Newark, Delaware: International 
Reading Association. 

(1980). Cloze Instruction Research: A Second Look. Newark, Delaware: Clearinghouse on 

Reading and Communication Skills. 

Karloff, K. R. (1977). Increasing comprehension with closed summaries. Journal of Reading 21. pp. 200- 
201 . 

Kennedy, D. K., and Weener, P. (1973). Visual and auditory training with the cloze procedure to 
improve reading and listening comprehension. Reading Research Quarterly 8. pp. 524-541. 

Kingston. A. J., and Weaver, W. W. (1970). Feasibility of cloze technique for teaching and evaluating 
culturally disadvantaged beginning readers. Journal of Social Psychology 82. pp. 205-214. 

Paradis, E. and Bayne, M. (1977). An examination of the use of cloze tasks during primary and grade 
reading instruction. Reading Improvement 14. pp. 57-61. 

Pepin, B. (1974) The cloze technique combined with high-interest, low-readability reading materials and 
language experience reading materials to improve the word knowledge and selected 
comprehension skill abilities of pupils in corrective reading classes. Dissertation Abstracts 
International 34. 3843A. . 

Pikulski, J. J. (1976). Using the cloze technique. Language Arts 53. pp. 317-318, 328. 

Plaister, T. (1973). Teaching reading comprehension to the advanced ESL student using the cloze 
procedure. Regional English Language Centre Journal 1973 4: 2. pp. 31-38. 


ERLC 



Radice, F. (1978). Using the cloze procedure as a teaching technique. English Language Teaching 
Journal. 32: 3. pp. 201-204. 

Rankin, E. F. (1977). Sequence strategies for teaching reading comprehension with the cloze procedure. 
In P. D. Pearson and J. Hansen (Eds.), Reading: Theory, Research, and Practice. Clemson, South 
Carolina: National Reading Conference. 

Rhodes, L. (1973). The effect of a cloze procedure methodology on reading comprehension of sixth grade 
students of varying reading ability. Dissertation Abstracts International 33 . 6598A. 

Sampson, M. R. (1979). Utilization of the cloze procedure as a teaching technique. Dissertation Abstracts 
International 40. 3107A. 

Sampson, M. R., Valmont, W. J., and Allen, R. V. (1982). The effects of instructional cloze on the 
comprehension, vocabulary and divergent production of third-grade students. Reading Research 
Quarterly 17: 3. pp. 389- 399. 

Seifeddin, A. H. (1988). Effect of the “cloze procedure” on improving reading comprehension of college 
students. Journal of Psychological and Educational Research 3:1. pp. 325-359. 

Sinatra, E. L. (1977). The cloze technique for reading comprehension and vocabulary development. 
Reading Improvement 14. pp. 86-92. 

Soudek, M. and Soudek, Lev (1983). Cloze after thirty years: New uses in language teaching. ELT 
Journal 37: 4. pp. 335-340. 

Smith, P. J. (1974). Kindergarten children’s abilities to use context on aural cloze passages. Dissertation 
Abstracts International 35. 3500A 

Whitmer, R. L. (1975). An investigation into the effectiveness of cloze and inferential techniques upon 
French reading comprehension at the intermediate college level. Dissertation Abstracts 
International 36. 3465A. 

Yellin, D. (1978). Two instructional strategies for reading comprehension employing the cloze procedure. 


Dissertation Abstracts International 39. 2056 A. 


11 


Appendix A 

The Listening Comprehension Test 

I. Directions: You will hear a statement for each set of pictures. Each statement will be spoken just one 
time. When you hear a statement, look at the three pictures and decide which one is correct. Then, on 
your answer sheet, find the number of the statement and mark your answer in the appropriate place. 
There will be a two-minute pause after each statement for reply. 

*The testees receive the following sets of pictures: 
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*The testees hear: 

1 . She is typing. 

2. She is saying goodbye to her husband. 

3. The puppet is tied to the tree. 

4. The car crashed into the tree. 

5. The farmer is pulling down the bucket. 

II. Directions: You will hear five statements about this picture but some are correct and others are 
incorrect. At the end of each statement mark “T” for true and “F” for false on your answer sheet. 
Each statement will be spoken just one time. There will be a two-minute pause after each statement 
for reply. 


*The testees receive this picture: 



* The testees hear: 

1 . The cow is turning the water wheel. 

2. The boy climbed the tree. 

3. Someone is lying under the tree. 

4. Some birds are flying in the sky. 

5. The man is driving a tractor. 
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III. Directions: You will hear a narrative text. At the end of this text, you will be asked five questions 
about what was said. After each question, you will hear three answers. On your answer sheet, find the 
number of the question and mark your answer in the appropriate place. There will be a two-minute 
pause after each question for reply. 

* The testees hear: 1 

My Cousin, John is a university student .// Last year/he went to italy/and stayed there for two months . Ill 
was surprised that John was able to have/such a long holiday/because he never has any money.// 

‘How did you manage it, John?7I asked.// T thought you were going to stay for two weeks.’// 

‘It was easy,’/ John answered.// ‘I got a job. 7/ 

‘A job !’/ 1 exclaimed .// ‘What did you do?’// 

7 gave English lessons to a grocer, ’/John answered.// ‘His name is Luigi.//We have become great 
friends.’// 

‘But you’re not a teacher,’ /I said.// 

7 told Luigi I couldn’t teach.’/ John explained.// ‘But he insisted on having conversation 
lessons.//He wanted to practise his English.//He has a lot of American customers, /so it is important for 
him to speak English.// I spent three hours a day talking to him. //In return / he gave me a room and a 
little pocket money.’// 

‘Did your pupil learn much English?’/I asked.// 

7 don’t know,’/ John said, /‘but I learnt a lot of Italian!’// 


I. Adapted from Alexander 1977. 
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* Choose the right answer 

(1 ) Why did John go to Italy? 

(a) to get a job (b) to have a holiday (c) to learn Italian 

(2) How long did John stay in Itally? 

(a) for a year (b) for two weeks (c) for two months 

(3) Why did Luigi want to practise his English? 

(a) because he has a lot of American friends 

(b) because he has a lot of money 

(c) because he has a lot of American customers 

(4) What is Luigi? 

(a) a teacher (b) a grocer (c) a butcher 

(5) What did John get in return for the lessons he gave? 

(a) a room (b) a little pocket money (c) both 

IV. Directions: You will hear five statements but some are true and others are false. At the end of each 
statement, mark “ I ” for true and “F” for false on your answer sheet. Each statement will be spoken 
just one time. There will be a two-minute pause after each statement for reply. 

1 . Carpets are made of glass. 

2. Bread is made by bakers. 

3. A carpenter is a person who makes furniture from wood. 

4. Plants can grow without water. 

5. Before electric lights were invented, people used to light houses with oil. 
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Appendix B 


Answer Sheet 

Name: 

School: Class: 
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